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The growing burden of type 2 diabetes 
melUtus and its cardiovascular com- 
plications (1-2) has forced American 
and European organizations to work for 
the development, specification, and field- 
testing of measures for quaUty of diabetes 
care (3-9). 
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Quality measures include process and 
intermediate outcome indicators, selected 
under the assumption that they are linked 
to downstream health outcomes. Process 
measures denote what is actually done 
to the patient (i.e., whether AlC [HbAij.] 
has been measured or an ACE inhibitor 



prescribed in the presence of a specific 
indication). Outcome measures are the re- 
sults of a patient health status as a conse- 
quence of the care delivered. Intermediate 
outcomes include laboratory measure- 
ments, physical signs, or symptoms. 

Although widely used by many or- 
ganizations worldwide, it is unclear 
whether selected indicators, which usu- 
ally include process and intermediate 
outcome measures, truly reflect the qual- 
ity of care delivered and its long-term 
consequences (10). Outcome measures 
have been criticized because they can be 
affected by factors other than the quality 
of care, such as patient characteristics and 
attitudes (11). However, process mea- 
sures alone do not fully describe the 
whole process of care. As an example, reg- 
ular testing of HbAic levels does not en- 
sure that the physician will adequately 
treat persistently elevated values (12). 
Furthermore, positive results in the short 
run could fail to be sustained in the long 
run, even in the presence of scientifically 
validated indicators. In fact, although 
widely used, it is unclear to what extent 
process and intermediate outcome mea- 
sures are able to predict long-term effects 
on patients' health. The Associazione 
Medici Diabetologi (AMD), an Italian di- 
abetes scientific society, developed qual- 
ity indicators to be used for the routine 
monitoring of diabetes care (9, 1 3) . In par- 
allel, AMD launched the QUASAR (Qual- 
ity Assessment Score and Cardiovascular 
Outcomes in Italian Diabetes Patients) 
study to evaluate whether these indicators 
were able to predict the incidence of final 
outcomes. In particular, we assessed 
whether a quaUty-of-care summary score 
estimated at baseline from the combina- 
tion of the main process and intermediate 
outcome indicators predicted the devel- 
opment of cardiovascular (CV) events 
during 30 months. 

RESEARCH DESIGN AND 
METHODS 

The Italian health care system 

All Italian citizens are covered by a govern- 
ment health insurance and are registered 
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OBJECTIVE — The QUASAR (Quality Assessment Score and Cardiovascular Outcomes in 
Italian Diabetes Patients) study aimed to assess whether a quality-of-care summary score pre- 
dicted the development of cardiovascular (CV) events in patients with type 2 diabetes. 

RESEARCH DESIGN AND METHODS— In 67 diabetes clinics, data on randomly se- 
lected patients were extracted from electronic medical records. The score was calculated using 
process and outcome indicators based on monitoring, targets, and treatment of AlC, blood 
pressure, LDL cholesterol, and microalbuminuria. The score ranged from 0 to 40. 

RESUiTS — Overall, 5,181 patients were analyzed; 477 (9.2%) patients developed a CV event 
after a median follow-up ol 28 months. The incidence rate (per 1 ,000 person-years) of CV events was 
62.4 in patients with a score of < 15, 4 1.0 in those with a score between 20 and 25 and 36.7 in those 
with a score of >25. Multilevel analysis, adjusted for clustering and case-mix, showed that the risk to 
develop a new CV event was 84% higher in patients with a score of < 15 (incidence rate ratio [IRR] = 
1.84; 95% confidence interval [CI] 1.29-2.62) and 17% higher in those with a score between 15 and 
25 (IRR = 1.17; 95% CI 0.93-1.49) compared with those with a score of >25. Mean quality score 
varied across centers from 16.5 ± 7.5 to 29.1 ± 6.3. When the score was tested as the dependent 
variable , it emerged that 1 8% of the variance in the score could be attributed to setting characteristics . 

CONCLUSIONS — Our study documented a close relationship between quality of diabetes 
care and long-term outcomes . A simple score can be used to monitor quality of care and compare 
the performance of different centers/physicians. 
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with a general practitioner (GP). Primary 
care for diabetes is provided by GPs and 
diabetes outpatient clinics (DOCs). Patients 
can choose one of these two ways of 
accessing the health care system or they 
can be referred to DOCs by their GPs. 
Within the Italian health care system more 
than 600 DOCs are in operation. 

Study design 

This observational longitudinal study 
involved DOCs adopting an electronic 
medical record system for the routine 
management of outpatients. 

Each center was asked to enroll up to 
100 patients, selected among individuals 
having a scheduled visit during 6 months, 
using random sampling lists. Eligible in- 
dividuals were men and women patients 
with type 2 diabetes mellitus, aged ^18 
years, irrespective of diabetes treatment 
and duration. Newly diagnosed patients 
were not included. At baseline, clinical 
data were automatically extracted from 
electronic clinical records using an ad 
hoc software. Information on CV events 
that occurred during three years was col- 
lected on ad hoc case report forms 
(Supplementary Fig. Al). All the data 
were analyzed anonymously, and patients 
were identified only by a numeric code. 

Patients were enrolled between Jan- 
uary 2006 and November 2007 and 
followed up until September 2009. The 
study was approved by local ethics com- 
mittees of all participating centers. 

Quality-of-care summary score 

A quality-of-care summary score (Table 1), 
developed and validated in a previous 
study (14), was applied to the QUASAR 
population to confirm its ability to predict 
the incidence of major vascular events. 

The score includes those process and 
intermediate indicators for which a clear 
link with vascular complications was 
demonstrated and effective preventive 
strategies are available. 

For each item, the highest score was 
assigned when the desired goals was 
attained, whereas the lowest score was as- 
signed when the patient was not treated 
for the specific condition despite elevated 
values or when the patient showed un- 
satisfactory values despite the treatment. 
Monitoring HbAic, blood pressure, lip- 
ids, or microalbuminuria less frequently 
than once a year was attributed an inter- 
mediate scoring under the assumption 
that these parameters could be less fre- 
quently monitored in individuals with 
less severe diabetes and in better control. 



Table 1 — Quality-of-care scoring system 



Quality-of-care indicator Scoring 



HbAic 
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LDL cholesterol, mmol/L (130 mg/dL) 




£3.37, irrespective of treatment 


0 


<3.37 


10 


MA measurement < 1/year 


5 


Not treated with ACE inhibitors/ARBs 




despite the presence of MA 


0 


Treated with ACE inhibitors/ARBs in 




the presence of MA or MA absent 


10 


Score range 


0-40 



MA, microalbuminuria; ARBs, angiotensin receptor 

blockers. 



After having developed the score in the 
QuED (Quality of Care and Outcomes 
in Type 2 Diabetes) study, we have em- 
pirically tested this aspect in the QUASAR 
study, where we have also collected blood 
samples, which were centrally analyzed. 
From these data it emerged that patients 
monitored less frequently tended to have 
lower HbAic and lipid levels and were 
markedly less likely to have microalbu- 
minuria. 

To avoid a strict dependence from the 
data, the scores attributed to each process 
and outcome measure were decided a 
priori and not based on weights derived 
from regression models applied to the 
data. Overall, the quality score ranges 
between 0 and 40, with a higher score 
reflecting better quality of care. The scor- 
ing system was applied to the data col- 
lected at study entry and tested as a 
predictor of incident CV events. Indica- 
tors were calculated using the last in- 
formation relative to the 12 months 
preceding the recruitment. Because nor- 
mal ranges for glycated hemoglobin 
varied among different centers, the per- 
cent change with respect to the upper 
normal value (actual value/upper nor- 
mal limit) was estimated and multipfied 
by 6.0. 

LDL cholesterol was estimated by the 
Friedwald equation. The score only in- 
cluded those indicators that could be 
easily retrieved from medical records. 
Additional indicators, such as foot or 



eye examination, although representing 
key components of diabetes care, were 
not considered, since information was 
reported in nonstandardized format in 
medical records. 

Incident CV events 

Information on CV events that occurred 
over three years was collected. The pri- 
mary composite end point was repre- 
sented by total CV events, including 
angina, myocardial infarction (MI), stroke, 
transient ischemic attack, coronary revas- 
cularization procedures, lower-limb com- 
pUcations (claudication, ulcer, gangrene, 
amputation, aortic-femoral revasculariza- 
tion procedures), and CV mortality. 

Secondary end points were repre- 
sented by major CV events (nonfatal 
MI, nonfatal stroke, CV mortahty), MI, 
cardiac revascularization procedures, 
stroke, lower-limb complications, CV 
deaths, and total deaths. 

MI was defined based on the presence 
of at least two of the following: I) typical 
ischemic chest pain, pulmonary edema, 
syncope, or shock; 2) development of 
pathological Q-waves and/or appearance 
or disappearance of localized ST-eleva- 
tion followed by T-wave inversion in 
two or more of twelve standard electro- 
cardiograph leads; and 3) increase in the 
concentration of serum enzymes consis- 
tent with MI. 

Stroke was defined on the basis of the 
presence of unequivocal signs or symp- 
toms of focal or global neurologic deficit, 
with sudden onset, lasting more than 
24 h, and considered of vascular origin. 

The following criteria were adopted 
to define CV death; death occurring 
within 28 days after the onset of the 
documented diagnosis of MI or stroke, 
in the absence of any other evident cause; 
sudden deaths; deaths from heart failure; 
and all other deaths classified as cardio- 
vascular (International Classification of 
Disease, ninth edition. Clinical Modifica- 
tion). The absence of any evident non- 
cardiovascular cause was sufficient to 
define a death as cardiovascular. 

All of the events were certified by the 
participating clinicians and were based on 
clinical documentation. Patients were 
contacted by phone if their last visit to 
the center had occurred more than 6 
months before. 

Statistical analysis 

Based on the results of the previous study, 
the quality score was categorized in three 
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Table 2 — Patient characteristics according to quality-of-care score 



Quality-of-care score 



Characteristic 
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Blood pressure (mmHg) 












Systolic 


152.2 ± 15.4 


144.9 


± 17.0 


128.1 ± 13.6 


<0.0001 


Diastolic 


85.6 ± 9.4 


82.6 


± 9.2 


77.3 ± 7.5 


<0.0001 


Cholesterol (mg/dL) 












Total 


224.3 ± 41.2 


193.5 


± 39.9 


177.3 


<0.0001 


LDL 


152.3 ± 28.1 


115.0 


± 35.0 


100.2 ± 25.2 


<0.0001 


HDL 


50.8 ± 11.6 


51.6 


± 13.2 


50.4 ± 13.3 


0.03 


Triglycerides (mg/dL) 


174.9 ± 107.5 


146.6 


± 126.73 


138.1 ± 82.8 


<0.0001 



Data are percentages or mean ± SD. *P values refer to x'^ for categorical variables and Kruskal-Wallis one-way 
AN OVA for continuous variable. 



classes; however, because of a general 
trend of improvements in the average 
quality of care in the last years, the cutoffs 
of the middle class were shifted ahead by 
5 points (<15, 15-25, >25). Patients' 
characteristics according to score classes 
were compared using the test for cate- 
gorical variables and the Kruskal-Wallis 
one-way ANOVA for continuous vari- 
ables. 

Incidence rates (IR) by score classes 
were expressed in terms of events per 
1,000 person-years. 

Probabilities of CV event according to 
score classes were calculated using the 
Kaplan-Meier method and compared us- 
ing the log-rank test. All reported P values 
are two-sided. 

To account for the multilevel nature 
of the data (patients clustered within 
diabetes clinic), and to control simulta- 
neously for the possible confounding 
effects of the different covariates, we 
used multilevel Poisson regression mod- 
els to investigate whether the score was 
an independent predictor of CV events 
incidence (15). In multilevel analyses 
patient-related characteristics were tested 
as level 1 variables, whereas setting- 
related characteristics represented level 2 
variables. The following patients' charac- 
teristics were tested: age, sex, BMI, dura- 
tion of diabetes and treatment, smoking, 
and history of previous CV event. The risk 
of CV events according to the score classes 
was expressed in terms of incidence rate 
ratio (IRR) and 95% confidence inter- 
vals (95% CIs), with a score of >25 as 
the reference category. 

Finally, we estimated the intraclass 
correlation coefficient (ICC) using the 
score as dependent variable to evalu- 
ate the extent to which the score varies 
between centers as compared with 
within-center variation, taking patient 
case-mix into account (16). The higher 
the ICC, the greater the influence of the 
physician-level on the quality-of-care 
score. 

RESULTS — The study was conducted 

in 67 diabetes clinics, and 5,181 patients 
were enrolled and followed up for a me- 
dian of 28 months (interquartile range 
24-31). Overall, 6.7% of the patients 
had a score of <15, 68.2% had a score 
between 15 and 25, and 25.1% had a 
score of >25. Patients' characteristics ac- 
cording to the score classes are reported 
in Table 2. Patients with the lowest score 
had a longer diabetes duration, and a 
larger percentage of them were already 



treated with insulin as compared with pa- 
tients in the other two score classes. 

During the follow-up, 477 (9.2%) 
patients developed one or more CV 
events. The CV event rate was strictly 
related to the score, being of 62.1 per 
1,000 person-years in patients with a 
score of <15, 41.0 per 1,000 person- 
years in those with a score between 15 
and 25, and 36.7 per 1,000 person-years 
in those with a score of >25. Unadjusted 
Kaplan-Meier curves show that a score of 
<15 was associated with a significant 
higher likelihood to develop a CV event 
(Fig. 1). 

Multilevel analysis, adjusted for clus- 
tering, age, sex, BMI, duration of diabetes, 
smoking, and history of CV event, 
showed that the risk to develop a new 
CV event was 84% greater in patients 
with a score of <I5 (IRR = 1.84; 95% CI 
1.29-2.62) and 17% higher in those 
with a score between 15 and 25 (IRR = 
1.17; 95% CI 0.93-1.49), as compared 
with those with a score of >25. A trend 
of increasing overall mortaUty according 
to the quality score was also documented, 
although statistical significance was not 
reached (IRR = 1.68; 95% CI 0.78-3.63 
and IRR = 1.35; 95% CI 0.83-2.21 for a 



score of < 15 and between 20 and 25, re- 
spectively, compared with a score of 
>25). The same trend of association 
was found for most of the outcomes, 
although statistical significance was 
reached for lower limb complications 
only (Fig. 2). The strong correlation be- 
tween the score of quality of care and CV 
events was evident in patients without 
previous CV events as well as in those 
who had already experienced a previous 
event (Supplementary Table Al). 

Finally, the mean quality score varied 
substantially across centers (from 16.5 ± 
7.5 to 29.1 ± 6.3). Mean quality score by 
center, adjusted for patient characteristics 
and clustering effect, is in Supplementary 
Fig. A2. When the score was tested as the 
dependent variable, it emerged that 25% 
of the variance in the score (ICC = 0.25) 
could be attributed to between center var- 
iation (i.e., to setting characteristics). 
When adjusting for case-mix (age, sex, 
BMI, duration of diabetes, previous CV 
events), variance attributable to center- 
level characteristics remained elevated 
(ICC = 0.18). 

CONCLUSIONS— Improving health 
outcomes is the ultimate goal of the health 



care.diabetesjournals.org 



Diabetes Cai!e, volume 34, February 2011 349 



Quality of diabetes care and CV events 



Score: 

<15 
15-25 




1,00 n 




0,95 - 




0,90 - 




0.85 




0.80 




0.75 




0,70 ■ 




0,65 - 




0,60 - 






15-25 


0,55 • 




0,50 - 


1 1 1 1 1 



Log-Rank Test: 

'/}: 9.0784 
p-value: 0.0107 



Days 



120 



-1 1 1 — r- 

360 



240 

332 (5) 324 (7) 316 (7) 
3531 (50) 3436 (48) 3361 (45) 3295 (39 



— I — I 1 1 1 — 

480 600 



T — |— 1 1 1 1 n 



345 (9) 



>25 1305 (1/) 12/1 (21) 1240 (13) 1219 (13) 1194 (14) 1086 (8) 

Figure 1 — Event-free survival; all patients by group score. 
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care system and should represent the 
main aim for any quaUty measurement 
program. From the data on more than 
5,000 patients with type 2 diabetes mel- 
litus routinely cared for by diabetes clinics 
and followed up for a median of 28 
months, we confirmed that a quality-of- 
care summary score, based on a restricted 
number of indicators, is able to predict 
total cardiovascular events. The trend of 
increase in the event rates with the pro- 
gressive reduction of the score is clear for 
all the selected outcomes, including over- 
all mortahty, although statistical signifi- 
cance was not reached. 

Our study substantially reproduces 
the body of evidence emerged by the 
QuED study (14), confirming the valid- 
ity and applicability of the instrument. 
In comparison with previous studies 
(14,17), conducted ten years ago in 
comparable settings, quality of care has 
improved, as reflected by the lower per- 
centage of patients scoring below 15 and 
the general shift of the score distribution 
toward higher values. Patients with a par- 
ticularly high risk of negative outcomes, 
i.e., those with a score of <15, now 
represent a small minority (6.7%). Acting 
to improve the performance in this small 
subgroup would hardly translate into tan- 
gible results at the population level, al- 
though individual patients would benefit 
from any quality improvement. On the 



other side, a large proportion of patients 
(i.e., 68.2%) lies in the 15-25 score 
range, associated with a nearly 20% in- 
creased risk of major events. A sub- 
stantially greater benefit could thus be 
expected by improving the monitoring 
and treatment of major cardiovascular 
risk factors in such a large population. 
The score can help identifying patients 
whose quality of care is suboptimal and 
in which aspects of care need to be im- 
proved. 

Reducing variation in health care de- 
livery represents a key component of any 
quality improvement initiative (18). In 
our study, mean quality score widely dif- 
fered among centers. It has been argued 
that process and intermediate outcomes 
can be affected not only by medical inter- 
ventions but also by patient factors (19); 
in other words, the score might reflect pa- 
tient variation rather than disparities in 
the quality of care. We showed that a rel- 
evant proportion of total variance was ex- 
plained by center-level characteristics 
(16), even after adjusting for patient 
case-mix. To this respect, the score seems 
to efficiently capture differences in the 
performance of the centers. The wide var- 
iation in health care delivery strongly sug- 
gests that a substantial proportion of 
cardiovascular events could be avoided 
by providing higher quality and more ho- 
mogeneous levels of care. The use of more 



standardized approaches could lead to 
sizeable savings in care and outcomes, 
particularly focusing the attention on the 
large proportion of patients falling in the 
intermediate category of the score. 

The possibility of calculating the 
quahty score from electronic medical re- 
cords in an easy and quick way makes its 
use particularly appealing. By allowing its 
automatic calculation, the score could be 
used not only to identify patients at risk 
for poor quality of care but also to 
monitor the performance of the center 
across the years. The score can also be 
used for multicenter, continuous quality 
improvement initiatives by providing a 
benchmark to which to compare individ- 
ual performance. This approach is being 
adopted in the context of a wide national 
initiative in Italy, involving over 250 di- 
abetes clinics for a total of half a million 
patients. The score wiU be calculated at 
the national, regional, and individual 
center levels, and the overall performance 
will be measured against that of the best 
performers. 

Some of the potential limitations of 
our study need to be discussed. First, 
physicians were selected according to 
their willingness to participate. They 
could thus represent those clinicians 
more interested in diabetes care and 
therefore not reflect the diabetes care 
delivered by Italian physicians. It is thus 
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Major CV events § 



Cardiac revascularization procedures 



Lower limb complications H 



CV deaths 



Overall mortality 
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possible that the differences documented 
in our study are underestimated and that 
the true variability in process and out- 
come measures is even greater. Similarly, 
patients attending diabetes clinics might 
differ from those primarily cared for by 
GPs; therefore, they could not be repre- 
sentative of all patients with diabetes. 
Second, the attainment of the desired 
therapeutic goals could be at least par- 
tially dependent on unmeasured patient 
factors; therefore, the intermediate out- 
come measures considered might not 
fully reflect the care provided. Third, the 
relatively short follow-up did not allow a 
robust estimate of the impact of the score 
on individual cardiovascular outcomes. 
Nevertheless, our results are highly con- 
sistent with those of the QuED study. 
Furthermore, an update of the study has 
been scheduled to evaluate the incidence 
rate of CV events after a 5-year follow-up. 
Finally, we have developed a score able to 
predict major cardiovascular events; a 
comprehensive quality-of-care measure 
should obviously also include process 
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and outcome measures related to micro- 
vascular complications. 

In conclusion, our study doc- 
umented a close relationship between 
quality of diabetes care and long-term 
outcomes. Our findings support the use 
of the indicators identified as an im- 
portant tool to assess the level of care 
provided within systems of care to pop- 
ulations of patients with diabetes. 
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